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Preface 


This document is the fifth in a series of reports which began in June 1992 under 
NASA (LRC) Grant No. NAG1-1-1327. The primary research effort has been to develop 
reliability and maintainability (R&M) models which can be used in support of the 
conceptual design of space transportation systems. The primary R&M model which has 
evolved from this research is described in Part (Volume) II of this report Part II serves as 
a user and maintenance manual in support of the model. The current version of the model 
has been significantly updated with more recent and more accurate aircraft and shuttle 
reliability and maintainability parameters. Associated with the research discussed in this 
report are several electronic data bases (primarily in the form of EXCEL workbooks) 
which captures the raw and processed R&M data which was used in the R&M model 

The principle researcher for this effort is Dr. Charles Ebeling, Department of 
Engineering Management and Systems, School of Engineering, University of Dayton, 
Dayton, Ohio 45469 - 0236, phone: 937-229-2695, fax: 937-229-2698; email: 
cebeling@engr.udayton.edu. Comments concerning this document and the accompanying 
software are welcome 
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Improved Supportability Analysis 


1. Introduction 

The University of Dayton is pleased to submit this report to the National Aeronautics and Space 
Administration (NASA), Langley Research Center, which updates recently developed computer 
models and data bases used in determining operational capabilities and support requirements during 
the conceptual design of proposed space systems. This research has resulted in some revisions of 
the reliability and maintainability (R&M) model, the development of several electronic data bases 
which capture the original data used in the R&M model, the collection of more recent R&M aircraft 
data and the integration of new shuttle data into the electronic data base and the R&M model. 
Descriptions of the model updates and of the electronic data bases are the subject of this report. 
Other details concerning the R&M model and the O&S costing model may be found in previous 
reports accomplished under this grant (NASA Research Grant NAG- 1-1 327) which are referenced 
in paragraph 1.3. 

1.1 Background 

The current R&M Model is based upon Air Force and Navy aircraft data covering the years 
1987 - 1991 and shuttle data collected in 1992 and covering missions STS-31R THROUGH STS- 
49. Because of the age of this data and the recent establishment of new R&M data collection 
systems, it was determined that more recent failure and maintenance data should be collected. 

Much of the current data reflects failures and technologies of the 1980s. There is a real need to 
update this data base with more recent aircraft and shuttle experience. Additionally, much of this 
data exists only in paper form making it difficult to access and use in further analysis efforts. 
Also, in completing a comprehensive study on specific vehicles, it became apparent that 
deficiencies still existed in the ability to relate design and performance goals with R&M, logistics 
support, and costs. 

With newer and more detailed data, more accurate R&M predictions can be obtained from 
the model’s parametric equations. Both the Air Force and the NASA contractors responsible for 
processing the orbiter have recently converted to newer reliability and maintainability data 
collection systems. The Air Force has modernized its R&M data collection system with REMIS - 
the Reliability and Maintainability Information System while Lockheed Martin completed a study 
this year that captures current shuttle R&M data updating the 1992 data base. In particular, 
maintainability data has been obtained from the Shop Floor Control/Data Collection (SFC/DC) 
system and reliability data has been obtained from the Problem Reporting and Corrective Action 
(PRACA) system. This research takes advantage of both of these new systems. In the process of 
obtaining this new data, procedures for the future collection and analysis of R&M was established. 
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1.2 Research Objectives 


The major objectives of this research are: 

a. to identify and resolve deficiencies in current methodology, 

b. to further develop and update an R&M data base, 

c. to enhance existing models, data, and procedures as necessary to support the study 
process. 

1.3 References 

Other reports completed as part of this research grant include: 

1 .3.1 "The Determination of Operational and Support Requirements and Costs During the 
Conceptual Design of Space Systems." Final Report. June 18, 1992. 

Describes the data sources, methodology, analysis, and results of the initial parametrically generated reliability and 
maintainability model. 

1.3.2 "Enhanced Methods for Determining Operational Capabilities and Support Costs for 
Proposed Space Systems." Final Report. June 1993. 

Describes the integration of shuttle data, the development of the NASA WBS into 33 subsystems, numerous 
enhancements to the model, the (optional) addition of an external tank and liquid booster rocket, a redesign of the 
user interface, and compiled version of the model. 

1 .3.3 "Operations & Support Cost Modeling of Conceptual Space Vehicles." Annual Report. 
June 1993 - July 1994. Presents an initial costing model to address operations and support costs. Integrates several 
different aircraft life cycle cost equations with shuttle derived values and direct user input based in part upon the 
following: 

1 .3.3. 1 Forbis and Woodhead, Conceptual Design and Analysis of Hyper velocity 
Aerospace Vehicles: Vol 3. Cost, WL-TR-9 1-6003, Volume 3, Boeing Military Airplanes, Jul 1991. 

1.3. 3. 2 Isaacs, R., N. Montanaro, F. Oliver, Modular Life Cycle Cost Model (MLCCM) 
for Advanced Aircraft Systems-Phase III, Vol VI, Grumman Aerospace, Jun 1985. 

•1.3. 3. 3 Kamrath, Knight, Quinn, Stamps, PREVAIL: Algorithms for Conceptual Design 
of Space Transportation Systems, Feb 1987. 

1.3. 3. 4 Logistics Cost Analysis Model, Advanced Manned Launch System (AMLS) Task 
Assignment 5, Rockwell International, Space Systems Division, September 10, 1993. 

1.3. 3. 5 Marks, Massey, Bradley, and Lu, A New Approach to Modeling the Cost of 
Ownership for Aircraft Systems, RAND, Aug 1981. 

1.3.4 "Integrating O&S Models During Conceptual Design - Part I," December 31, 1994. 

1.3.4 "Integrating O&S Models During Conceptual Design - Part II, Reliability and Maintainability Model 
(RAM), User and Maintenance Manual." December 31, 1994. Provides detailed user documentation of the RAM 
model as well as source listings, a complete glossary, flow charts, menu hierarchy, and step by step procedures for 
using the model. 

1 .3.5 "Integrating O&S Models During Conceptual Design - Part III, Simulation of Maintenance and 
Logistics Support of Proposed Spaces Systems Using SLAM II." December 31, 1994. Documents the SLAM 
maintenance model including a complete example. 
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1.3.6 “O &S Analysis of Conceptual Space Vehicles," Annual report - Part I, December 31, 1995. 
Documents updates and changes to the RAM model and the support cost model. Develops and illustrates techniques 
for performing a manpower amalysis and a parametric analysis for many of the RAM model input parameters. 

1.3.7 ‘‘Reliability and Maintainability Model (RAM), User and Maintenance Manual," Annual Report - 
Part II, December 31, 1995. Provides detailed user documentation of the current RAM model as well as source 
listings, a complete glossary, flow charts, menu hierarchy, and step by step procedures for using the model. Part II of 
this current report updates and replaces the 1995 version of the User and Maintenance Manual. 
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2. Model Changes and Enhancements 

One of the research objectives is to enhance the R&M model as necessary to support the 
study process. Several enhancements and changes have been made from the baseline documented 
in paragraph 1.3.7. 

2.1 Scheduled Maintenance 

The previous modification to the model resulted in the specification of scheduled 
maintenance by subsystem as well as by vehicle (periodic maintenance). An option to allocate the 
total scheduled maintenance hours per mission to each subsystem was accomplished by using the 
relative weights of the subsystems. The latest update now provides an option to allocate by a fixed 
percentage of the unscheduled maintenance hours as well. The specified default option for 
scheduled maintenance hours per mission is now based upon new parametric aircraft equations 
which were derived from more recent R&M data. They will be applied when recomputing the 
model output with the scheduled maintenance selection set to “recompute” unless the option to use 
weight based or percent based allocations are made at the scheduled maintenance screen. If the the 
scheduled maintenance selection upon recomputing is set to “do not compute,” then the current 
scheduled maintenance hours at displayed on the scheduled maintenance input screen will remain 
fixed. When the default option (aircraft equations) is active, those subsystems identified as “shuttle 
based” will use the corresponding shuttle scheduled hours. This completes the recent transition to a 
detailed subsystem based calculation of scheduled maintenance replacing the original vehicle level 
calculations. 

2.2 Computation of MTBMs 

In order to provide consistency in the manner in which both aircraft and shuttle mission 
(inherent) and ground (external) MTBMs are computed from an overall MTBM, the aircraft 
methodology was changed as follows: 

TOTAL MAs = MSN HRS/SPACE ADJ MTBM 

+ GRND PROC HRS/TECH ADJ MTBM ( 1 ) 

MSN MTBM = MSN HRS / (p x TOT MA) (2) 

GRND MTBM = GRND PROC HRS/( [ 1 -P] x TOT MA) (3) 

where p = the fraction of the total maintenance actions (MA) occurring during the mission 
time (inherent failures). The space adjusted and technology adjusted MTBMs are based upon the 
aircraft parametric equations which provide the initial unadjusted MTBMs. There are two 
differences in the way that the shuttle MTBMs are computed. First, the initial unadjusted MTBMs 
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are obtained from the collected shuttle data directly rather than from parametric equations. Second, 
the space adjustment is not applied. Therefore Equation (1) is modified as follows: 

TOTAL MAs = MSN HRS/ TECH ADJ MTBM 

+ GRND PROC HRS/TECH ADJ MTBM (4) 

Table 1 Summarizes the sequence of MTBM calculations: 


Table 1 . MTBM Calculations 


Vehicle 

Initial 

MTBM 

Technology 

Adjustment 

Space 

Adjustment 

Total MAs 

Mission 

MTBM 

Ground 

MTBM 

Shuttle 

from data 

applied 

N/A 

from (4) 

from (2) 


Aircraft 

from Eqs 

applied 

applied 

from (1) 

from (2) 

from (3) 


2.3 Shuttle R&M Parameters 

As a result of the new shuttle data, the mean time (operating hours) between failures 
(MTBM), the maintenance hours per maintenance action (MHMA), removal rates (RR), and 
average crew sizes (CS) by subsystem were replaced. In addition, scheduled maintenance hours by 
subsystem were computed and incorporated into the model. This required a new file maintenance 
screen to display and update their values if necessary. Logic was also provided to automatically 
apply these values to those subsystems identified as being shuttle based. Table 2 compares the new 
parameters with their current values. Blanks in Table 2 indicate no data was available while zeros 
reflect computed values. The derivation of the shuttle R&M parameters across missons is 
discussed in Section 5 and was accomplished using EXCEL spreadsheets. 
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Table 2. Comparison of Shuttle R&M parameters 


System WBS old- new old new 

MTBM MTBM MHMA MHMA 


141.8 21.375 


212.5 21.375 


13.38 21.375 


1730.5 0 


0 


1.37 44.1 


35.87 29.7 


23.34 37.53 


149.55 33.255 


19.86 30.42 


52.29 30.42 


80.05 71.28 


73.42 39.645 


95.13 | 56.34 


0 


85.31 64.8 


27.20 22.41 


60.97 33.21 


182.62 33.255Y 


427.54 151.695 


0 


94.995 13.04 


TCS 


PVD 


L. Gear 


Main Pro 


RCS 


QMS 


APU 


Batte 


Fuel cell 


Electrical 


Hydraualics 


Aero surfaces 


GN&C 


Health 

monitor 


old Rem 
Rate 

new 

Rem 

Rate 

.143 

.22 

.143 

.16 

.143 .23 1 

.216 

Lq 

.216 | 


3.30 66.22 


Controls 


Instruments 


13.40 34.52 


13.50 47.2 


13.60 9999 


14.10 I 24.47 


89.73 210.015 17.75 


71.82 40.14 19.66 


297.88 61.065 18.14 


96.91 41.22 25.8 


100.95 41.22 19.59 


Parachute 


Crossfeed 


Dockin 


16.30 11.99 


16.40 9999 


16.50 3108.85 


16.60 42.12 


1345.96 


519.16 
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System 

WBS 

Wing 

1.00 

Tail 

2.00 

Body 

3.00 

LOX 

3.10 

LH 


Tiles 

4.10 

TCS 


PVD 

4.30 

L. Gear 

5.00 

Main Prop 

6.00 

MPS 

6.10 

RCS 

7.00 

OMS 

8.00 

APU 

9.10 

Battery 

9.20 

Fuel cell 

9.30 

Electrical 

10.00 


11.00 

Aero surfaces 

12.00 

GN&C 

13.10 

Health 

13.20 



Controls 

13.40 

Instruments 

13.50 



Table 2 (continued) 


old avg 
crew size 

new avg 
crew size 

scrap 

rate 

scheduled 
manhours per 
mission 

4.5 

1.48 

.02 

148.23 

4.5 

1.17 

.11 

218.1 

4.5 

1.37 

.03 

3226.41 

9 

2.06 

0 

150.48 

iihh 




4.5 

1.81 

.05 

1841 


1.51 

.19 

1456 

4.5 

1.29 

.07 

487.3 

4.5 

1.55 

.10 

1603 

9 

1.21 

.07 

3712 

9 

2.09 

.08 

11120 

9 

1.23 

.03 

1343 

4.5 

1.18 

.04 

1961 

9 

1.19 

.14 

672.8 

4.5 




4.5 

1.20 

0 

912.8 

4.5 

1.16 

.04 

431.5 

9 

1.22 

.10 

379.6 

4.5 

1.38 

.06 

71.09 

4.5 

1.17 

.04 

88.19 





H 

1.40 

.02 

540.3 

4.5 

1.18 

.02 

179.5 

9 

1.24 

.07 

722.7 

4.5 

1.17 

0 

164.2 

9 

1.42 

.08 

404.4 

9 

1.19 

.11 

411.7 

mm 

1.37 


2598 

4.5 




EH 

1.15 

.01 

514.6 

9 

1.13 

.15 

243 

4.5 




4.5 

1.99 

.02 


4.5 

1.85 

.05 

763 




































































































































































2.4 Aircraft Equations 


Based upon REMIS data collected for the 1 995 calendar year at the aircraft mission- 
design (MD) level, over 160 new multiple regression equations were derived and entered into the 
RAM model. NCSS was the statistical package used for performing the regression analysis. As 
was the case in the derivation of the original equations, individual independent (driver) variables 
were included or excluded based upon their statistical significance as measured by the student t- 
statistic (or equivalently the prob-value). The overall model was evaluated based upon the 
cofficient of determination (R 2 ) or its square root, the index of fit (R). The candidate independent 
variables were identical to those used in the original equations except, where necessary, they were 
averaged across each mission-design-series (MDS) comprising an MD. New equations were 
derived for the following R&M parameters: 

Flying Hours Between Maintenance Actions (FHBMA) 

Maintenance Hours per Maintenance Action (MHMA) 

Removal Rate (fraction removed per maintenance action) (RR) 

Fraction Off Equipment (fraction of total maintenance actions 
performed off vehicle) (POFF) 

Average Crew Size (CS) 

Scheduled maintenance hours per operating hour (SP) 

The original model contained only average crew sizes with no parametric equations. 
Therefore these equations are new to the R&M model and required some additional software 
modifications to incorporate them into the model. The fraction of the total failures which are 
inherent equipment failures was updated using the 1995 data. As was the case in the previous 
version of the RAM model, there were no regression equations derived for this parameter since the 
total failures themselves are determined parametrically based upon the FHBMA. Scheduled 
maintenance hours per operating hour equations are new and a . new module (SCHED) was created 
which evaluates these equations during recomputations. Critical failure rate (i.e. abort rate) 
equations were not updated since this parameter was not available within the REMIS system. 
Individual equations and their statistical analyses are found in Appendix A. The regression data 
points (both independent and dependent variables) are included in the electronic data bases 
(MD95.XLS) discussed in the following section. 
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3. Electronic Data Bases 


One primary tasking of this research effort consisted in providing current data in electronic 
form and obtaining more recent R&M data also in electronic form. All data in electronic form are 
either in EXCEL workbooks or in a MICROSOFT data base system called ACCESS. Some 
EXCEL workbooks can be imported into the ACCESS data base. Therefore, certain data will 
reside in two places but in different formats. These data fdes are discussed further in Sections 4 and 
5. The primary EXCEL ( .xls) data files consist of: 

Table 3. EXCEL Data Files 


File Name 

Original File Date - Size 

Decsription 

MASTERWU.XLS 

9/17/96-228,864 

Contains the original (1988-1989) R&M 
data by WUC (worksheets) and by aircraft. 

MODASAIR.XLS 

9/9/96 - 809,984 

Contains more recent ( 1 990- 1991) MOD AS 
data for selected aircraft with worksheets by 
AIRCRAFT and by month. 

MODASWUC.XLS 

9/9/96 - 848,384 

Same data as AIRCRAFT.XLS except 
worksheets are by WUC. 

B1BDATA.XLS 

9/23/96 - 730,1 12 

Contains recent (Jan-May 96) REMIS 
MTBM data at the detailed (5-digit) WUC 
level for the BIB aircraft. 

F16ADATA.XLS 

9/23/96 - 552,960 

Contains recent (Jan-May 96) REMIS 
MTBM data at the detailed (5-digit) WUC 
level for the F- 16 aircraft. 

MDyr.XLS 
where yr = 92, 93, 
94, 95, or 96 

9/4/96 
92: 496,128 
93: 529,408 
94: 464,384 
95: 467,456 
96: 455,680 

Contains R&M parameters computed from 
REMIS data for the year indicated. Data is 
summarized at the MD level and at the 2- 
digit WUC. 

UNSDDATA.XLS 

8/30/96 - 603,648 

Contains shuttle unscheduled maintenance 
data obtained from Lockheed-Martin study 
organized by subsystem. 

SCHEDATA.XLS 

8/25/96 - 330,752 

Contains shuttle scheduled maintenance 
data obtained from Lockheed-Martin study 
organized by subsystem. 





















4. Aircraft Reliability and Maintainability Data 


4.1 REMIS Aircraft Data Workbooks for Years 1992-1996 

The REMIS system was used to obtain reliability and maintainability data for Air Force 
aircraft for the years 1992 through June 1996. This data has been used to calculate the reliability 
and maintainability (R&M) parameters used in the Reliability and Maintainability Model (RAM). 
All of the data are contained in six Microsoft™ Excel 5.0 Workbooks: md92.xls, md93.xls, 
md94.xls, md94.xls, md95.xls, and md96.xls (January through June). Each of these workbooks 
can be imported into the Reliability and Maintainability Database (ACCESS) software for 
additional analysis. 

All of the workbooks are identical in format. The first sheet is the REMIS INFO sheet. 
This sheet lists the various aircraft, work unit codes (WUC), and dates for which the REMIS 
database was searched. The aircraft and WUCs are the same for all of the workbooks; only the 
dates are different. 

The second sheet is the Definition sheet. The REMIS data was collected at the two-digit 
Work Unit Code (WUC) level for various aircraft. These WUCs are defined at the left of this 
sheet 1 . The independent variables used in the regression analysis of the R&M data are defined 
down the right side of this sheet. The REMIS data was collected for several R&M parameters 
such as number of maintenance actions (TOT MA). These parameters are defined beneath the 
WUC and independent variable definitions. The REMIS data was then used to calculate 
additional R&M parameters such as maintenance hours per maintenance actions (MHMA). 

These parameters are defined at the bottom of the sheet. 

The next three sheets are the IndepVars (Independent Variables) sheets. These sheets list 
the values of the independent variables used to analyze the R&M data in establishing the 
regression equations used in RAM. The variables have been separated onto three sheets so that 
the variables can be read without having to scroll the screen. 

The weights of the aircraft subsystems specified by the two-digit WUCs are listed on the 
WUC Weights sheet. General operating information such as number of operating hours, number 
of aircraft, and support general scheduled hours (sg_sch_hours) for all of the aircraft are entered 
in the Operlnfo sheet. 


1 The data for WUC55 was not retrieved from REMIS. The WUC55 sheet is a ‘dummy’ sheet so 
that the workbook can be imported into the database software. Data for WUC65 was retreived 
from REMIS. Due to the implementation of the database, this WUC data will not import into the 
database. 
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Next are the sheets which list the R&M data. There is one sheet per WUC, and all sheets 
have the same format. An example sheet is listed in Figure I. Left of the vertical double lines 
are the R&M parameters calculated from the REMIS data. Below the single horizontal line are 
summary statistics for these parameters. To the right of the vertical double lines are the raw 
REMIS data and the ‘formulas’ used to calculate the R&M parameters. 

The spreadsheet format left of the vertical pair of lines is required by the R&M Database 
(ACCESS) software and cannot be changed. The aircraft are listed down the leftmost column 
under the heading VEHICLE. The next ten columns contain the R&M parameters for the various 
aircraft. The headings of the columns specify the R&M parameters for which data is available. 
Data for abort rate (ARATE) could not be found in the REMIS database so there are no data in 
that column. There are also no data in the RESERVE column by design 2 . The summary 
statistics beneath the R&M parameter data are simple average (mean) and standard deviation 
(STD DEV). 

The raw REMIS data is to the right of the vertical pair of lines. Next to the REMIS data, 
delineated by a single vertical line, is another copy of the R&M parameters which were 
calculated from that data. The R&M parameter values are the same as those at the left side of the 
workbook. However, this copy has the actual formulas used to calculate the R&M parameter 
values. Highlighting any cell causes the formula used to calculate the data value in that cell to be 
displayed at the top of the sheet. These formulas are addressed in the following paragraphs. 

The first R&M parameter is flying hours between unscheduled maintenance actions. It is 
calculated by dividing the total operating time (flying hours) by the total number of maintenance 
actions. 


FHBMA = -2^ 
Tot MA 


2 This column is a space holder for an additional R&M parameter which may be included at a 
future time. The R&M Database software is designed to read from spreadsheets with fixed 
formats. Therefore a blank column was added to the spreadsheets too retain some 
flexibility in using the R&M Database software. 
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WUC23 


Figure 1. Example EXCEL WUC spreadsheet 
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Unscheduled maintenance hours per maintenance action is calculated by dividing the sum 
of the on-vehicle and off-vehicle maintenance hours by the total number of maintenance actions. 


. ... On VehHrs + OffVehHrs 

MH / MA = — 

TotMa 

The percentage of unscheduled maintenance hours performed off-vehicle is calculated by 
dividing the number of off-vehicle hours by the sum of the on-vehicle and off-vehicle 
maintenance hours. 


PctOff = 


OffVehHrs 

OffVehHrs + OnVehHrs 


The removal rate is the percent of total maintenance actions for which a removal was 
required. It is calculated by dividing the number of removals by the total number of maintenance 
actions. 


RemRat = 


NbrRem 

TotMA 


Sorties between unscheduled maintenance actions is calculated by dividing the total 
number of sorties by the total number of maintenance actions. 

sbma = 

TotMA 

The crew size to perform unscheduled maintenance is calculated by dividing the R&M 
parameter MH/MA by the REMIS mean repair time (MRT). 

crew = M1LLMA 

MRT 

The fraction of unscheduled maintenance actions resulting from inherent equipment 
failures is calculated by dividing the number of inherent maintenance actions by the total number 
of maintenance actions. 


Pctlnher = 


InhMA 

TotMA 
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The last R&M parameter is percent scheduled maintenance hours per flying hours. It is 
calculated by dividing the number of scheduled maintenance hours by the total operating hours 
(flying hours). 


SchMH / FH = 


SchedHrs 

OpTime 


After all of the WUC data sheets, there are four sheets which are regression analysis 
templates. The first sheet is for single variable linear regression analysis. The remaining three 
sheets are for 2 variable, 3 variable, and 4 variable linear regression analysis respectively. Refer 
to Section 4.5 on how to perform regression analysis using Excel for more information. 

The final sheet in the workbook is the REMIS data as imported directly from the REMIS 
system file. This data has been left in the workbook as a backup to the data in the WUC sheets 
and as a source of data for additional analysis. 


4.2 REMIS DETAIL DATA FOR F16A & BIB 

Reliability and maintainability data for five digit work unit codes was retrieved from the 
REMIS system for the F16A and BIB aircraft. The data is contained in two Microsoft™ Excel 
5.0 Workbooks named F16ADATA.DOC and B1BDATA.DOC. 

The two workbooks are identical in format. All of the data for an aircraft is presented in the first 
sheet. The top of the sheet is the header from the REMIS report. Below the header is the REMIS 
data. The format of the data is as follows: 


Figure 2. REMIS Detail Data Format 


WUC 

110 

WUC DEFINITION 

MTBM 

INHERENT 

11000 
1 1 A 


8 

124.2 

11A00 

DOORS 

44 

657.5 

11A99 

NOC 

5.7 

96.4 

11AA0 

ENTRY DOOR & LADDER 

103.5 

859.9 


TOTAL 


INDUCED 

NO DEFECT 

CORRECT 

PREVENT 

14 

26.5 

7.9 


99.8 

159.7 

43.8 


15.1 

15.5 

5.7 

5589.1 

228.1 

414 

102.6 

11178.2 


The left column of the sheet lists the work unit codes (WUCs). The second column lists the 
definition of the WUCs. These definitions were not retrieved from REMIS. They were obtained 
from existing data files which were downloaded from the MODAS system during a previous 
work effort. The next six columns list the maintainability and reliability data. They are defined 
as follows: 
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MTBM: mean operating time (flying hours) between maintenance actions 

INHERENT: mean operating time (flying hours) between inherent failures 

INDUCED: mean operating time (flying hours) between induced failures 

NO DEFECT: mean operating time (flying hours) between no defects found 

TOTAL CORRECTIVE: mean operating time (flying hours) between corrective maintenance 

PREVENTATIVE: mean operating time (flying hours) between preventive maintenance 

4.3 Original Aircraft Reliability and Maintainability Data Spreadsheet 

The original RAM R&M data is contained now in a Microsoft™ Excel 5.0 Workbook 
(MASTERWU.XLS). The workbook is comprised of many individual sheets. The sheets 
contain the aircraft reliability and maintainability (R&M) parameters and data used in the original 
Reliability and Maintainability Model (RAM). The data were obtained from the published report 
titled “AFALC Pamphlet 800-4, Volume V, October 1985-September 1987” and were entered 
into the spreadsheet manually. 

The first sheet is the Definition sheet. The R&M data was collected at the two-digit 
Work Unit Code (WUC) level for various aircraft. These WUCs are defined at the left side of 
this sheet. The independent variables used in the regression analysis of the R&M data are 
defined down the right side of this sheet. The data was collected for various R&M parameters 
such as maintenance hours per maintenance actions (MHMA). These parameters are defined at 
the bottom of this sheet. 

The next three sheets are the IndepVars (Independent Variables) sheets. These sheets list 
the values of the independent variables used to analyze the R&M data to establish the regression 
equations used in RAM. The variables have been separated onto three sheets so that the 
variables can be read without having to scroll the screen. 

The weights of the aircraft subsystems specified by the two-digit WUCs are listed on the 
WUC Weights sheet. 

The remaining sheets list the R&M data. There is one sheet per WUC, and all of the 
sheets have the same format 3 . An example sheet is in Figure 3. The aircraft are listed down the 
leftmost column under the heading VEHICLE. The next ten columns contain the R&M data for 
the various aircraft. Definitions of these parameters are at the bottom of the Definition sheet. 

The average and standard deviation of the data is calculated for each parameter. Some sheets 
have columns to the right of the R&M data after a blank column. These columns list 
independent variables which are unique to the particular WUC. Note that the after the last WUC 
there a sheet just for the avionics system. 


3 The format of the sheets is fixed so that the data can be imported into the Access Database 
program. 
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Figure 3. Example WUC SpreadsheetofMASTERWU.XLS 
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The last for sheets in the workbook are regression analysis templates. The first sheet is 
for single variable linear regression analysis. The remaining three sheets are for 2 variable, 3 
variable, and 4 variable linear regression analysis respectively. Refer to Section 4.5 of this report 
on how to perform regression analysis using Excel for more information. 

4.4 MODAS Aircraft Data Spreadsheets 

Aircraft abort, failure, and maintenance data for the years 1990 and 1991 obtained 
electronically from the MODAS system are summarized in two Microsoft™ Excel 5.0 
Workbooks. The MODASAIR.XLS workbook summarizes the data by aircraft, and the 
MODASWUC.XLS workbook summarizes the data by Work Unit Code (WUC). 

MODASAIR.XLS Workbook 


Monthly maintenance, failure, abort and data was retrieved electronically from the 
MODAS system by WUC for various aircraft. The MODASAIR.XLS workbook contains the 
original monthly data as well as summary data. 

The workbook begins with a sheet, WUCdefs, listing the WUCs for which data was 
obtained and their definitions. The second sheet is a roll-up summary, by aircraft, of all of the 
MODAS data. Each row of the summary data is the total of the 1990-1991 monthly 
maintenance, failure, abort data across all WUCs for an aircraft. This data is calculated from the 
original MODAS data. 

The remaining sheets in the workbook contain the original MODAS data as well as some 
summary information. There is one sheet for each aircraft and each sheet is identical in format. 
Each sheet is divided into three sections by horizontal vertical lines. The bottom section is the 
original data as retrieved from MODAS. There is one block of data for each WUC. The block 
lists the monthly maintenance, failure, and abort data for that WUC throughout 1990-1991. At 
the bottom of the block, totals and average are calculated. These totals are the maintenance, 
failure, and abort data for a WUC over the entire two year period. 

The middle section of the sheet lists these totals again (the WUC totals from the bottom 
section) to form a comprehensive summary of the data by WUC. An example WUC totals 
(middle section) for the FI 1 IE is displayed in Figure 4. The meaning of the column headings 
should be clear except for Tl, T2, and T6. T1 refers to inherent equipment failures, i.e., failures 
from design or manufacturing anomalies. T2 represents induced failures, i.e., failures from 
improper maintenance procedures, foreign objects, etc. Any reported failure which cannot be 
found or duplicated is recorded against T6. 
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The top section of each spreadsheet is a roll-up of the middle section. It is the total 
maintenance, failure, and abort data for the aircraft over the two year period. Note that this line 
of data is simply copied into the Summary sheet. 

MODASWUC.XLS Workbook 

The same monthly maintenance, failure, abort and data as in the MODASAIR.XLS 
workbook is summarized by WUC (instead of aircraft) in the MODASWUC.XLS workbook. 

The workbook begins with the same WUC definitions sheet as is in the MODASAIR.XLS 
workbook. The second sheet is a roll-up summary, by WUC, of all of the MODAS data. Each 
row of the summary data is the total of the 1990-1991 monthly maintenance, failure, abort data 
across all aircraft for a WUC. This data is calculated from the original MODAS data. 

The remaining sheets in the workbook contain the original MODAS data as well as some 
summary information. There is one sheet for each WUC and each sheet is identical in format. 
Each sheet is divided into three sections by horizontal vertical lines. The bottom section is the 
original data as retrieved from MODAS. There is one block of data for each aircraft. The block 
lists the monthly maintenance, failure, and abort data for that aircraft throughout 1990-1991 . At 
the bottom of the block, totals and average are calculated. These totals are the maintenance, 
failure, and abort data for an aircraft over the entire two year period. 

The middle section of the sheet lists these totals again (the aircraft totals from the bottom 
section) to form a comprehensive summary of the data by aircraft. An example aircraft totals 
(middle section) for WUC1 1 is displayed in Figure 5. 

The top section of each spreadsheet is a roll-up of the middle section. It is the total 
maintenance, failure, and abort data for the WUC over the two year period. Note that this line of 
data is simply copied into the Summary sheet. 
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Figure 4. Example MODAS Data Organized by Aircraft 
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Figure 5. Example MOD AS Data Organized by WUC 
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4.5 Regression Analysis Using Excel 

The REMIS data workbooks and original data workbook all have four sheets at the end of 
the workbooks which are templates for performing regression analysis on the data within the 
workbooks. The four templates are for single-variable, two-variable, three-variable, and four- 
variable regression analysis respectively. The methodology for performing regression analysis 
will be explained by working through examples of single-variable and two-variable regression. 

Single- Variable Regression 

The template for single variable regression consists of a data section and a calculation section. 
The data section is displayed in Figure 6a , and the calculation section is displayed in Figure 6b. 
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Figure 6a: Data Section of Single-Variable Template 
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Figure 6b: Calculation Section of Single-Variable Template 
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Data is copied from WUC and IndepVars sheets into the data section of the template. 

First the complete list of vehicles is copied into the cells beneath the vehicle heading. Next the 
dependent variable values from the desired WUC sheet are copied into the cells under the Y 
heading. Lastly the independent variable values from an IndepVars sheet are copied into the cells 
beneath the X 1 heading. It is very important that the vehicles get copied for each analysis 
because any vehicle for which data is not available must be deleted from the data section. The 
regression equation cannot compensate for missing data. If new independent or dependent 
variable values are copied into the data section without copying the list of vehicles, the data will 
not line up correctly. 

To the right of the vertical double lines in the middle of the data section, are additional 
columns which can be used to transform the independent variable data. Transformation of the 
independent variable may result in an improved fit. In this example, the logarithm and square 
root of the independent variable data are calculated and displayed. 

The formula to calculate the regression statistics is 

LINEST(Y W Y 1 end ,X 1 start :X 1 cnd ,TRUE,TRUE) . 

LINEST performs a linear regression of the data in the cell ranges specified in the equation. The 
first parameter of the equation is the range of cells containing the dependent variable values. The 
second parameter of the equation is the range of cells containing the independent variable values. 
Detailed information about this formula can be found in Excel’s help menu. 

For the specific example considered above, the regression equation for X 1 is 

LINEST(A3:A19,B3:B19, TRUE, TRUE) . 

Whereas, the equation for the square root transformation of X 1 is 

LINEST(A3:A 1 9,F3 :F 1 9,TRUE,TRUE) . 


23 



The results of the evaluation of the LINEST equation are in the calculation section. Across the 
top and along the left side of the calculation section are simple text labels to identify to 
regression results. The results are the numerical values as displayed in the above figure. The 
results are an array of values. LINEST always returns an array of values. To enact a change in 
the regression equation, simply highlight a cell in the array, make the desired change, and then 
press CTRL& S HT &ENTER. 

Two-Variable Regression 

Two-variable regression differs from single variable regression only in the specification of the 
independent variable cell ranges. The second parameter of the LINEST equation must always be 
a continuous range of cells. Therefore, for all multiple regression analysis the independent 
variables, either untransformed or transformed, must be copied next to one another as a 
continuous block of cells. An example data section and a calculation section for two- variable 
regression are presented in Figures 7a and 7b. 


Figure 7a. Data Section for Two-Variable Template 
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Figure 7b. Calculation Section for Two-Variable Template 
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As with single variable regression, the aircraft and dependent variable values are copied 
from the WUC sheets into the first two columns. However, the independent variable values are 
copied from the IndepVars sheets into the cells to the right of the vertical double lines. Then the 
independent variable values, either untransformed or transformed, which will be used in the 
regression equation are put next to the dependent variable values (just left of the vertical pair of 
lines). In Figure 7a, the values for independent variable X2 have been copied untransformed and 
transformed. The equation for two-variable regression analysis is always: 

LINEST(B3:B 1 3 ,C3 :D 1 3 , TRUE, TRUE) . 

Note how the second parameter is specified as a block of cells which contains all of the 
independent variable values (either untransformed or transformed). For multiple regression the 
equation never has to be changed. As different independent variable values are copied into 
columns C and D, the equation will automatically be recalculated and displayed in the calculation 
section. Also, for all three multiple regression sheets a t statistic is calculated. This is an added 
calculation. It is not a result of LINEST. 
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5. Shuttle Scheduled and Unscheduled Reliability and Maintainability Data 

Space shuttle maintenance data obtained from the Operations and Support Database and 
Analysis Study by Lockheed Martin Manned Space Systems has been summarized in two 
Microsoft™ Excel 5.0 Workbooks. The scheduled maintenance data is in the SCHEDDATA.XLS 
workbook, and the unscheduled data is in the UNSDDATA.XLS workbook. 

The shuttle maintenance data as received from Lockheed Martin was organized by Space 
Transportation System (STS) number. The maintenance data for each STS number was 
presented in individual spreadsheets. Within each spreadsheet the data was organized by shuttle 
flight system codes. In order to incorporate this data into the Reliability and Maintainability 
Model (RAM), the data has been reorganized by Work Breakdown Structure (WBS). The data 
for each WBS is now presented in individual spreadsheets, and within each of these spreadsheets, 
the data is organized by STS number. 

The SCHEDDATA.XLS and UNSDDATA.XLS workbooks contain many individual spreadsheets. 
The first sheet in each workbook is the Definitions sheet. It lists the shuttle flight system codes 
with their definitions in ascending order and the corresponding Work Breakdown Structure 
(WBS) codes. It also lists the WBS codes with their definitions in ascending order and the 
corresponding shuttle flight system codes. The Definitions sheets for the SCHEDDATA.XLS and 
UNSDDATA.XLS workbooks are different because unscheduled maintenance tasks were recorded 
for shuttle flight system codes for which scheduled maintenance was not performed. The 
remaining sheets contain the shuttle maintenance data for each WBS, template sheets which 
contain the formulas used to calculate summary statistics, and original maintenance data for 
subsystems which were not incorporated into WBS codes. 

5.1 Scheduled Maintenance Data 

There is one spreadsheet for each WBS. All the sheets are identical in format. An example sheet 
is in Figure 8. The columns left of the vertical double lines present the mission information and 
the maintainance data for the WBS listed in the upper left comer of the sheet. Right of the 
vertical double lines are the subsystem data, as obtained from Lockheed Martin, which was 
combined to calculate the maintainance data for the WBS. Data for different subsystems is 
separated by one vertical line. Below the horizontal double lines are summary statistics of the 
WBS maintainance data. 
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Figure 8. Example Worksheet - Shuttle Scheduled Maintenance Data 
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The first column lists the STS number. The next four columns list summary information 
about the individual missions: OV (orbiter vehicle number), launch date, FPOT (flight power-on 
time), and GPOT (ground power-on time). The data in these five columns is the same for each 
sheet in the workbook. 


The next three columns list the maintainance data for the WBS as calculated from the 
corresponding subsystem data: TASKS (number of tasks performed), MEAN Task Time, and 
MEAN Manhrs (manhours). The TASKS values are calculated by summing the subsystem 
TASKS values for each STS. The MEAN Task Time values are a weighted average of the 
subsystem MEAN Task Times for each STS: 


tasktime WBS 


s TASKS* MEANtasktime 

AllSubsys 

X TASKS 

AllSubsys 


Similarly, the MEAN Manhrs values are a weighted average of the subsystem MEAN Manhrs for 
each STS: 


manhrs ms = 


I TASKS* MEANmanhrs 

AllSubsys 

I TASKS 

AllSubsys 


The last column of WBS data is MEAN Crew Size. These data values are calculated by dividing 
MEAN Manhrs by MEAN Task Time. The MEAN Crew Size values listed for the individual 
subsystems are the original values obtained from Lockheed Martin; they are not calculated as has 
been done for the WBS values. 

Summary statistics of the maintainance data include: total, simple average, weighted 
average, and average scheduled manhours per mission. Totals for FPOT, GPOT, and TASKS are 
calculated by simply summing all the values within a column. A simple average is also 
calculated for FPOT, GPOT, and TASKS. The simple average is calculated by dividing the total 
value by the number of missions (26). An exception is the average number of tasks for WBS 
3.10. In this case, the total is divided by 8 since there are data for only eight missions. Weighted 
averages are calculated for Task Time, Manhrs, and Crew Size: 


I TASKS* MEANtasktime 

AVEtasktime = MMswss. 

X TASKS 

AllMissions 
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I TASKS* MEANmanhrs 

A VEmanhrs = 

X TASKS 

All Miss ions 


X TASKS* MEAN crew 

A VEcrew = 

X TASKS 

AllMissions 

Lastly, the average scheduled manhours per mission is calculated: 

'ZTASKS* MEANmanhrs 

A VEmanhrs / mission = 

26 

The values in the WBS spreadsheets are numbers. There are no formulas to ensure that 
no errors occur as data is imported and exported to other applications. The TEMPLATE sheet 
after all of the WBS sheets contains example data and formulas used. Highlighting a cell causes 
the formula to be displayed at the top of the sheet. The formulas in the template sheet match 
those in this discussion. Note that there is a scratch space area with intermediate calculations 
below the summary statistics. 

The seven sheets after the TEMPLATE sheet contain the original Lockheed Martin data 
for subsystems that were not incorporated into the WBS codes. 

5.2 Unscheduled Maintenance Data 

There is one spreadsheet for each WBS. The sheets are identical in format except for one 
cell (to be discussed later). An example sheet is in Figure 9. The columns left of the first pair of 
vertical lines present the overall mission information and maintainance data for the WBS listed 
in the upper left comer of the sheet. Right of the first pair of vertical lines are the subsystem 
data, as obtained from Lockheed Martin, which was combined to calculate the maintainance data 
for the WBS. Data for different subsystems is separated by two vertical lines. Below the 
horizontal double lines are summary statistics of the WBS maintainance data. 

The first five columns list summary information about the individual missions: STS number, OV 
(orbiter vehicle number), launch date, FPOT (flight power-on time), and GPOT (ground power- 
on time). The data in these five columns is the same for each sheet in the workbook, and is the 
same as in the scheduled maintenance data sheets. 
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Figure 9. Example Worksheet - Shuttle Unscheduled Maintenance Data 
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Figure 9. Example Worksheet - Shuttle Unscheduled Maintenance Data (continued) 
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The remaining columns before the first pair of vertical lines contain the maintenance data for the 
WBS. The WBS maintenance data is separated from the mission information and is also divided 
into to sections by single vertical lines. The SHOP FLOOR data corresponds to the top section 
of data in the original Lockheed Martin spreadsheets. The PRACA data corresponds to the 
bottom section of data in the original Lockheed Martin spreadsheets. The subsystem data is also 
divided into SHOP FLOOR and PRACA sections by a vertical line. 


The WBS SHOP FLOOR data is summarized in four columns: MAIN. ACTIVITIES 
(number of shop floor maintenance activities), MTTR HOURS (mean time to repair in hours), 
MAIN. MANHRS (maintenance manhours), and CREW SIZE. The column of MAIN. 
ACTIVITIES values are calculated by summing the subsystem shop floor MAIN. ACTIVITIES 
values for each STS. The MTTR HOURS and MAIN. MANHRS values are weighted averages 
of the subsystem MTTR HOURS and MAIN. MANHRS for each STS: 


MTTRwgs — 


X ACTIVITIES* MTTR 

AUSuhswjSHOP) 

I ACTIVITIES 

AllSubsyst SHOP ) 


MANHRS wbs 


I ACTIVITIES* MANHRS 

AllSubsys{ SHOP ) 

^ACTIVITIES 

AllSubsysi SHOP ) 


The last column of shop floor data is CREW SIZE. These data values are calculated by 
dividing MANHRS by MTTR. As with the scheduled maintenance data, the CREW SIZE values 
listed for the individual subsystems are the original values obtained from Lockheed Martin; they 
are not calculated as has been done for the WBS values. 

The WBS PRACA data is listed in three columns: MAIN. ACTIVITIES, REMOVAL 
RATE, and SCRAP RATE. The column of MAIN. ACTIVITIES values are calculated by 
summing the subsystem PRACA MAIN. ACTIVITIES values for each STS. The REMOVAL 
RATE and SCRAP RATE values are weighted averages of the subsystem REMOVAL RATE 
and SCRAP RATE values for each STS: 


REMOVAL^s = 


I ACTIVITIES* REMOVAL 

AUSuh.iy.if PRACA) 

X ACTIVITIES 

AllSubns( PRACA ) 
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SCRAP wbs — 


Z ACTIVITIES* SCRAP 

AllSubsrsj PRACA) 

I ACTIVITIES 

A OSuhsysi PRACA } 


The final column of WBS maintenance data is MAX. ACTIVITIES. The MAX. 
ACTIVITIES values are the maximum of the shop floor and PRACA MAIN. ACTIVITIES 
values. For some missions, more shop floor maintenance activities were recorded than PRACA 
activities. Selecting the maximum value of the two MAIN. ACTIVITIES ensures that all 
recorded maintenance activities are included in the summary statistics. If only the PRACA 
values were used, the total number of maintenance activities would be too low. These values are 
used to calculate the mean number of missions per maintenance activity as described in the 
following paragraphs. 

There are two sets of summary statistics, separated by a single line, beneath the 
maintenance data. The two sets calculate the same statistics but use different missions. The top 
set includes all the missions in the calculations. The bottom set does not include missions STS- 
53, STS-66, and STS-73. 

Summary statistics of the maintainance data include: total, simple average, weighted 
average, MTBF (mean time (GPOT+FPOT) between failures), and MTMF (mean operating time 
or missions between failures). Totals for FPOT, GPOT, and shop floor MAIN. ACTIVITIES, 
and MAX. ACTIVITIES are calculated by simply summing all the values within a column. A 
simple average is calculated for FPOT, GPOT, REMOVAL RATE, SCRAP RATE, and MAX. 
ACTIVITIES. The simple average is calculated by dividing the total value by the number of 
missions which have recorded maintenance activities. Weighted averages are calculated for 
MTTR, MANHRS, and CREW SIZE: 


^ ACTIVITIES* MTTR 

A VEmttr = 

X ACTIVITIES 

Missions 


X ACTIVITIES* MANHRS 

A VEmanhrs = M,ssmns 

X ACTIVITIES 

Missions 


X ACTIVITIES* CREWSIZE 

A VEcrew — 

X ACTIVITIES 

Missions 
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The mean time between failures is calculated by dividing the sum of GPOT and FPOT by the 
total MAX. ACTIVITIES. 


MTBF, 


GPOT '+ FPOT 


GPOT+_FPOT 

^ ^ MaxA ctivities 


The final statistic calculated is MTMF. If at least one subsystem in a WBS does not have 
recorded operating hours, the mean number of missions between failures is calculated: 


MTMF = 

1V11 IV1 r MISSIONS 


1 

Simple Average UaxAclmlies 


Otherwise, the mean operating time between failures is calculated: 


MTMF 0pHrs/ Fmlure 


OperatingHours 

Tot a l Maj ^Activities 


The value for OperatingHours is the largest of all of the subsystem’s PRACA data OPER. 
HOURS within the WBS. 


As with the scheduled maintenance data, the values in the WBS spreadsheets are 
numbers. There are no formulas to ensure that no errors occur as data is imported and exported 
to other applications. The TEMPLATE(l) and TEMPLATE(2) sheets after all of the WBS 
sheets have data and formulas. TEMPLATE(l) uses a WBS with no recorded operating hours so 
the mean number of missions between failures is calculated. TEMPLATE(2) uses a WBS with 
recorded operating hours so the mean operating hours between failures is calculated. 

Highlighting a cell causes the formula to be displayed at the top of the sheet. Note that there are 
two scratch space areas with intermediate calculations below the summary statistics. 

The nine sheets after the TEMPLATE sheet contain the original Lockheed Martin data for 
subsystems that were not incorporated into the WBS codes. 
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6.0 NASA RELIABILITY AND MAINTAINABILITY DATA BASE SYSTEM 


6.1 Overview 

The Reliability and Maintainability Database (R&M DB) was developed to provide 
the Langley Research Center personnel the capability to review and analyze aircraft 
(vehicle) reliability and performance data utilizing a relational database and graphic user 
interface (GUI) as an alternative to the Excel spreadsheets presented earlier. The goals of 
the R&M DB are to 

1 Provide easy access to reliability and maintainability data either by specific vehicle (e g 
F-15C) or by Work Unit Code (WUC). This is accomplished by a GUI that is divided 
into three categories; Report Operations, Import Data and Data Review, and 
Regression Analysis 

2 Provide basic statistical analysis of reliability and maintainability data by either vehicle 
or by WUC The typical values provided are raw sample size, minimum and maximum 
data points, averages, and standard deviations. The database also provides a weighted 
average of reliability and performance factors against either a specific vehicle or a 
WUC 

3. Provide regression analysis of independent variables (e g. number of control surfaces) 
versus a dependent variable (e g flying hours between maintenance activities). The 
regression analysis is allowed against any WUC utilizing any independent/dependent 
variable combination. The presentation of the regression data is both tabular as well as 
graphical. The user is provided the ability to select linear, exponential, logarithmic, 
polynomial, or power regression analysis against the raw data. 

4. Provide hard-copy report of performance data either by vehicle or WUC. 

This discussion consists of two primary sections, R&M DB Functionality and the 
database design specifications. The R&M DB Functionality will provide an overview of 
the major functions and their associated screens within the database. The database design 
specifications will provide the overall table structure with their fields and the relationships 
between each of these tables Several temporary tables that are used for importing the raw 
R&M data are not depicted since they are only used during the import process. 

6.2 Functionality 

The R&M DB functionality is broken down into five main categories: 

Import WUC spreadsheet 

Active file selection. 

Data Review 
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selection screen. Upon selecting the file to be imported. The path/file name is returned to 
the Import Control Screen to allow the user to import the selected file into the R&M DB 


Figure 12. File Selection Screen. 



The File Selection Screen contains push buttons for sorting the files in ascending or 
descending order, changing the current directory, and opening or selecting the file for 
return to the Import Control Screen. 
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Table 4. Import Control Field Definitions. 


Field Name 

Require 

d/ 

Optional 

Field Description 

j i! Database 
, Table ;; 

tUMHH 

Import Date 

Required 

Import Date in combination 
with the Import Time provide a 
system generated date/time 
stamp of when the WUC 
spreadsheet record set was 
imported into the R&M DB. 

Import 

Control 

Import 

Date 

Import Time 

Required 

Import Date in combination 
with the Import Time provide a 
system generated date/time 
stamp of when the WUC 
spreadsheet record set was 
imported into the R&M DB 

Import 

Control 

Import 

Time 

Description 

Optional 

Provides user with the ability to 
add a note or description 
concerning the import of the 
WUC spreadsheet. 

Import 

Control 

Description 

File 

Required 

Provides the location of the file 

Import 

Import File 

Path/Name 


and name of the file to be 

Control 

Name 



imported into the R&M DB. 
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Figure 11. Import Control Screen. 



The Import File push-button, locates and imports the file specified in the File 
Path/Name field into the R&M DB. The import process runs for several seconds, bringing 
in each individual sheet within the WUC spreadsheet into a temporary database area prior 
being committed to the permanent working table in the database. The reason for using 
temporary tables is two fold. First, to allow validation of data on a sheet by sheet basis 
(i.e. WUC1 1, WUC12, etc ) This allows validation to occur field by field. In the event of 
an individual field error, just the individual field will be left empty instead of rejecting all 
fields within a vehicle record. The second reason, is in case of a major import error when 
reading each of the WUC sheets. In this case, an error message will occur indicating 
which sheet had the error Since a major error will cause the entire sheet to be rejected, 
the import process stops, and deletes the temporary tables to prevent corruption of the 
R&M DB The user will then need to correct the error and re-import the spreadsheet into 
the database If their are no errors, the temporary tables are committed or moved to the 
permanent tables, with the main window being updated with the new date/time stamp 
indicating that this is now the current record set for review and analysis. 

The find file push-button (shapes like a magnifying glass), opens the dialog box 
presented in Figure 12. This essentially allows the user to locate the WUC file through a 
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selection screen. Upon selecting the file to be imported. The path/file name is returned to 
the Import Control Screen to allow the user to import the selected file into the R&M DB. 


Figure 12. File Selection Screen. 



The File Selection Screen contains push buttons for sorting the files in ascending or 
descending order, changing the current directory, and opening or selecting the file for 
return to the Import Control Screen. 
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6.2.2 Active file selection. 


The Active File Selection screen performs two primary functions, selecting an import 
record set for conducting analysis and review against, and deleting record sets that are no 
longer required for analysis and review. 

The screen defaults to showing the current record set that is active (see Figure 13). This 
is the same record set whose date/time stamp is displayed on the main window. 


Figure 13. Import Selection Screen. 



In order to change the record set, use the mouse to select the drop-down list located in the 
upper right comer of the Import Selection Screen. A list of the imported record sets will 
be displayed for selection (see Figure 14). Select the desired record set. The record sets 
Import Date, Time, Description, and File Path/Name will appear. To select the file as the 
active file, either enter Alt + S, or press the Select push-button. This record will now be 
active record set for analysis and review. 
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In order to delete the record set, follow the same procedures for selecting the 
record from the drop-down list. After the record set’s data has appear, either enter Alt + 
D; or press the Delete push-button to delete the record set. If the record-set chosen for 
deletion is the current, active record set, an error message indicating that the active record 
set cannot be delete. Just select a new record set to be active using the above procedures, 
and then use the drop-down list to bring the old record set’s data back for deletion as 
outlined above. This prevents deletion of all record sets from the database. 


6.2.3 Data Review. 

The Data Review section is divided into five areas. Vehicle Display, WUC Display, 
Independent Variable Statistics, Database Statistics, and Independent Variable Review 
Each screen is described in detail below. 

6.2.3. 1 Vehicle Display. 

The Vehicle Display (See Figure 15) provides R&M performance data by individual 
vehicle. The screen contains independent data by select vehicle with associated WUC 
data. The independent vehicle in the upper section of the screen is file maintainable. 


41 





however the WUC data is not. The R&M performance data by WUC has an average and 
weight average calculated for each dependent R&M variable. 


Figure 15. Vehicle Display Screen. 



The average is just a simple average across all non-zero/blank R&M dependent variables. 
The Weighted Average is calculated as show below for FHBMA followed by the 
remaining R&M performance variables: 


WT FHBMA = 


FHBMA 


^ R&M Variable * 


WT R& M Variable = 


FHBMA 


FHBMA 


The Vehicle Display Screen contains a drop-down list in the upper comer that allows 
selection of any vehicle for review/file maintenance of independent variables and review of 
associated WUC data. By selecting the vehicle of interest, the screen is automatically 
updated with the corresponding data. 
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6.2.3. 2 WUC Display. 


The WUC Display (Figure 16) is very similar to the vehicle display, except the focus is 
now based upon an individual WUC, such as structures (WUC1 1), and the R&M 
Performance data across all associated vehicles. 


Figure 16. WUC Display. 



The average is just a simple average across all non-zero/blank R&M dependent variables 
The Weighted Average is calculated as show below for FHBMA followed by the 
remaining R&M performance variables: 


1 

WT FHBMA = 

y — - — 

^ FHBMA 


WT R& M Variable 


^ R&M Variable * 


1 

FHBMA 


z — - — 

^ FHBMA 
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The WUC Display Screen contains a drop-down list in the upper comer that allows 
selection of any WUC for review of a WUC and its associated Vehicle data. By selecting 
the WUC of interest, the screen is automatically updated with the corresponding data. 

6.2.3.3 Independent Vehicle Summary Statistics Display. 

The Independent Vehicle Summary Statistics Display provides an analysis of the 
independent vehicle data across all vehicles in the record set. The sample size, maximum 
and minimum points, averages, and standard deviation are calculated and displayed (see 
Figure 17). This screen provides a good statistical summary of independent vehicle data. 
The average represent what a typical vehicle’s independent data would look like. 

Figure 17. Independent Vehicle Summary Statistics Screen. 
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6.2. 3.4 Data Base Statistics Summary. 


The Data Base Summary Statistics Display provides an analysis of the dependent R&M 
performance data across all vehicles and WUCs in the record set. The sample size, 
maximum and minimum points, averages, and standard deviation are calculated and 
displayed (see Figure 1 8). This screen provides a good statistical summary of what a 
typical or average vehicle’s dependent R&M performance data would look like. 


Figure 18. Data Base Statistics Summary Screen. 
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6.2.3.5. Independent Variable Display. 


The Independent Variable Screen provides a detailed listing of all Independent Vehicle 
data that was imported from the Excel spreadsheet. The report is broken into three pages 
that list all independent variables by vehicle. Figure 19 shows a sample of page 1. To see 
page 2 or 3, select the Page 2 or Page 3 push-button located in the lower left comer of the 
screen. To view the remaining vehicle’s independent data, scroll down using the scroll bar 
located along the right edge of the screen Vehicles are listed in alphabetical order. 

Figure 19. Independent Variable Vehicle Display - Page 1. 
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6.2.4 Data Regression Analysis. 

The R&M DB provides five models, linear, exponential, lognormal, polynomial, or power 
to perform regression analysis by using the "least squares" method to fit a line or curve 
through a set of observations. You can use this tool to analyze how a single dependent 
variable is affected by the values of an independent variable (see Figure 20). 

Figure 20. Regression - Exponential. 



The regression analysis screens allow for any combination of Independent Variable to 
WUC to Dependent Variable. After the appropriate variables have been selected, enter 
the Update Data Point push-button to have the R&M DB to update the Regression Data 
Points table. The column headers for x and y will match the values selected. At this point 
the values can be modified, added, or deleted in order to provide a “what-if ’ analysis 
capability. Once the values in the Regression Data Point table are entered, select the 
Update Regression Plot push-button to update the graph and calculate the R-square value 
The graph will display the corresponding x and y values in the Regression Data Points 
Table indicating the values have been updated. 
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6.2.5 Report operations 


The R&M DB allows for two reports to generated. The first is the Vehicle Summary 
Report which is similar to the Vehicle Display Screen. The report displays each vehicle’s 
independent data followed by the WUC R&M performance data. The report is generated 
across all vehicles The second report is the WUC Summary Report. This report displays 
each WUC with its associated R&M performance data for each vehicle. Both reports go 
directly to the printer when their push-button is entered. 


6.3 Database Design Specifications. 

Figure 21 displays the primary tables, attributes and relationships used within the R&M 
DB 


Figure 21. Table Relationship Diagram. 
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6.4 Recommended Improvements. 


6.4.1 Trend Analysis. Add capability to provide trend analysis of R&M 
performance factors across user specified time-frames. Data would be displayed in tabular 
and graphical format similar to regression data 

6.4.2 Multi-variant Regression Analysis. Expand regression capability 
to perform multi-variant regression analysis. Variables would be specified by the user and 
displayed in tabular and graphical format similar to the single variable regression data in 
current model. 


6.4.3 Import File Validation and Error Checking. Add capability to 
validate individual work unit codes and associated fields. Generate report to identify 
individual field corrections by worksheet/attribute/cell. This would assist in identifying 
corrections required to excel spreadsheet used for input. 

6.4.4 Improve Graphical User Interface (GUI). Utilize standard 
Windows GUI dialog boxes for file selection. Add menu picks to quickly navigate to 
screens/reports. Add search capabilities to locate data of interest. Allow user to create 
dynamic SQL queries to generate customized data selection reports. Add additional user- 
defined reports on statistical analysis, as well as, ability to print screens directly. 

6.4.5 Space Shuttle Specific R&M Data. Add specialized screens and 
reports associated with shuttle specific data. 
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Multiple Regression Report 
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Root Mean Square Error 6.619129E-02 Root Mean Square Error 4.338097E-02 

Mean of Dependent Variable 1.314 Mean of Dependent Variable .371 

Coefficient of Variation 5.037389E-02 Coefficient of Variation .1169290 
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Dependent Variable: CREWSIZE 
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-Ratio Prob. Level 
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